A generalization of the Mehta-Wang 
determinant and Askey- Wilson polynomials 

Masao ISHIKAWA* 1 , Hiroyuki TAGAWA t 2 , and Jiang ZENG 3 

^Department of Mathematics, Faculty of Education, University of the Ryukyus, 
Nishihara, Okinawa 901-0213, Japan, ishikawa@edu.u-ryukyu.ac.jp 
2 Department of Mathematics, Faculty of Education, Wakayama University, 
Sakaedani, Wakayama 640-8510, Japan, tagawa@math.edu.wakayama-u.ac.jp 
3 Institut Camille Jordan, Universite Claude Bernard Lyon 1, 69622 Villeurbanne 
cedex, France, zeng@math.univ-lyonl.fr 

2010 Mathematics Subject Classification : Primary 05A30 
Secondary 05A15, 15A15, 33D45. 

Keywords : The Mehta-Wang determinants, the moments of the little q-Jacobi 
polynomials, the Askey- Wilson polynomials. 

Abstract 

Motivated by the Gaussian symplectic ensemble, Mehta and Wang 
evaluated the n x n determinant det((a + j — i)F(b + j + i)) in 2000. 
When a = 0, Ciucu and Krattenthaler computed the associated Pfaf- 
fian Pf((j — i)T(b + j + i)) with an application to the two dimensional 
dimer system in 2011. Recently we have generalized the latter Pfaf- 
fian formula with a g-analogue by replacing the Gamma function by 
the moment sequence of the little g-Jacobi polynomials. On the other 
hand, Nishizawa has found a (/-analogue of the Mehta-Wang formula. 
Our purpose is to generalize both the Mehta-Wang and Nishizawa for- 
mulae by using the moment sequence of the little g-Jacobi polynomi- 
als. It turns out that the corresponding determinant can be evaluated 
explicitly in terms of the Askey- Wilson polynomials. 

1 Introduction and the main results 

Motivated by the Gaussian symplectic ensemble, Mehta and Wang [2] obtain 
the determinant identity 

n-l 

det ((a + j - i)T(b + i + j))o< M <„_i = ^11 z!r > + ( L1 ) 
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where (N.B. the binomial coefficient (?) is missing in [JJJ (7)]) 



D n = £( 



fc=0 



;i.2) 



n—k 



r ^"' ) is known as the rising factorial. This D n satisfies the 
three term recurrence relation 



where (a) n 



£>-i = 0, D 



D 



n+1 



aD r 



n(b + n- l)D n _x, 



;i.3) 



which can be considered as the recurrence relation for a special case of the 
Meixner-Pollaczek polynomials (see [14j [15]), and one may notice that the 
sequence {T(b + n)} n >o of the Gamma functions in the left-hand side can 
be considered as the moment sequence of the Laguerre polynomials (see, for 
example, [10j HTJ [T7]). Nishizawa [15] obtains a g-analogue of ( II. ip . which 
will be stated below. Here we replace the Gamma functions by the moments 
of the little g-Jacobi polynomials and show that we obtain a special case of 
the Askey- Wilson polynomials as D n , which also generalize the two results 
in our previous papers [5J [TJ. Before we describe our results we need more 
notation. 

Throughout this paper we use the standard notation for g-series (see 

[Damnum): 



(a; q)oc = JJ(i 



aq 



(a;q) r 



(a;<?)c 



k=0 



(aq n ;q) c 



for any integer n. Usually (a; q) n is called the q-shifted factorial, and we 
frequently use the compact notation: 

(ai, a 2 , • • • , a r ; q) n = (ai; q) n (a>2; q) n ■ ■ • (a r ; q) n . 

The r +i4>r basic hypergeometric series is defined by 

ai, a2, • • • , a r+ i 



r+Wr 



q,Z 



n=0 



h, ...,b r 

Here we also use the g-Gamma function 

(1-9) 



(ai, a2, • • • , a r+ i; 

9) 



(q,h, . . .,b r ;q), 



(1.4) 



i- 2 (?;?)c 



(? 2 ;^)c 



the g-integer [n] 5 = and the g-factorial [n] g ! = rifc=iWg- By taking the 
limit g — > 1, we obtain the hypergeometric function 



r+l "r 



Oil, Oi 2 , 



Oir+1 



E 

n=0 



(a 1 ) n (a 2 ) n ■■■(a 



r+1 Jn 



n! (/3i) n - •■(&), 
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The Askey-Wilson polynomials p n (x) [U dOl CUE] satisfy the well-known re- 
currence relation 

2xp n (x) = A n p n+l (x) + B n p n (x) + C n p„_i(x), n > 0, (1.5) 

with p-i(x) = 0, Po( a; ) = 1) where 

1 — abcdq n ~ l 



A, 



C n 



(1 - abcdq 2n - r ) (1 - abcdq 2n ) ' 

(1 - <f) (1 - afrg™- 1 ) (1 - acq™- 1 ) (1 - adq 11 " 1 ] 

(1 - abcdq 2n ~ 2 ) (1 - abcdq 2 ^ 1 ) 
x (1 - bcq^ 1 ) (1 - bdq 71 - 1 ) (1 - crfg"" 1 ) , 



and 



B n = a + a~ l - A^a- 1 (1 - abq n ) (1 - acq n ) (1 - a(ig n ) 
- C n a/ (1 - a&g^ 1 ) (l - acg"" 1 ) (l - adq^ 1 ) . 

They have the basic hypergeometric expression 

, , , . (ab,ac,ad;q) n . I ' q~ n ,abcdq n ~ 1 ,ae t6 \ae~ ld 
p n {x; a, b, c, d; q) = 4 3 ; q, q 



ab, ac, ad 

with x = cos 9, where % = y/—l. We also use the symbol 



(1.6) 



1 if A is true, 
if A is false. 



In [6] we have proven the Hankel determinant identity 

. / (aq: q)i+j +r -2 \ n(n-l) n (n-l)(2 n -l) n(n-l)r 

det rn / = a 2 g 6 + 2 

x tt (q,bg;(i)k-i(aq; gW-i ^ 7 ^ 

A = l (a6g 2 ; g) fc+n+r _ 2 
for a positive integer n. Here 

A*n = 7V2 N ("- = 0,1,2,...) 

(a&g 2 ; q) n 

is the moments of the little g-Jacobi polynomials. In our previous paper [7] 
we have exploited the Pfaffian identity 



V {abq 2 ;q) i+j+r _ 2 J 



i+j+r-2/ l<i : j<2n 
n-1 



a n(n-l) g ^-±i) + „(n-l)r TT (fo? . ) TT (gj ^ K gWzl (l.g) 

fc = l fc = i ( a6 9 > Q)2(k+n)+r-3 
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for a positive integer n (see also 

In [15] Nishizawa has proven the g-analogue of the Mehta-Wang result: 

det([a + j-i] q T q (b + i + j)) 



[ ;3t 

n-1 



q na + n(n-l)b/2+n(n-l)(2n-7)/6 ^ JJ[ fc ] ? | . T q {b + k) , (1.9) 



k=0 

where D nq satisfies the recurrence relation 

£>-i, g = 0, D 0tq = l, D n+ltq ^q- a+n [a] q D n>q + q- a - b [n] q [b + n-l] q D n _ ltq 

(1.10) 

Comparing this recurrence relation with the recurrence equation 

2xQ n {x) = Q n+1 (x) + (A + B)q n Q n (x) + (l-q n )(l-ABq n - 1 )Q n „ 1 (x) (1.11) 
of the Al-Salam-Chihara polynomials 

Qn{x) =Qn{x;A,B;q) = — — — 3 2 I ^ Q ;q;q\ (1.12) 

with x = cos 9 (see [TDl ELI]), we may remark that -D n (J can be considered as 
a special case of the Al-Salam-Chihara polynomials because 

D n , q = (-i)V 2 * in (l - (0; g^z, -g^z; g) . (1.13) 

By this observation, we can write D n%q explicitly as 

,»(«+»)(,_ 11 ■ t 1 - 14 ' 

One natural question we may ask is what can we obtain if we replace the 
g-Gamma function in the determinant of (jl.9p by the moment of the little 
g-Jacobi polynomials. The aim of this paper is to answer this question, and 
we can express the determinant by the Askey- Wilson polynomials. 

Theorem 1.1. Let a, b and c be parameters, and let n > 1 and r be integers. 
Then we have 



i i j / i-l 7 -l\ ( a Q'i l)i+j+r-2 \ 

det (g - cq 3 ) —— J 

V. {abq 2 ;q) i+j+r _ 2 J 



3Sn 



^n a i^ g "("+^"-5) + 2i^^ a6cgr+ i. q2 ^ n -q (?; g)fc-i(ag; gW(&g; g) fc _ 2 



(afrg 2 ; g) fc+n+r _ 2 



1 1 r+1 - ,n+r 



x 403 r+1 1^1 1 ' r±i 1,1 1 i+i;g,g (1.15) 

\aq \a202c2q 2 ,— a2&2C2g 2 

n ( n-2) „ „(n-2)(2n+i) . w (n-2)r j^r (q; q)t-_i fag; ql^-i (6q; g) h _y 
[—1) a 2 c 2 g e 2 



A; = l 



(a&g 2 ; g) fc+n+r ._ 2 



/ 11 r + l 1 _1 r + 1 1 1 \ 

x p n 0;a 2 c 2 g 2 ^ ? _ a2c 2g 2 i,b 2 z,—b 2 z;q) . (1-16) 
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Remark 1.2. If we put c = in (I1.15p . then we recover our previous result 
f ll.7p easily by using the g-Chu-Vandermonde formula |H (1.5.3)] 



2<Pl 



c ;q > q ) = ^ r qT a - (L17) 

c / \ u i H)n 



If we put a = q a 1 ,6 = 0,c = g 7 and r = in (I1.15p . then the left-hand side 
equals 

n(n — 1) 2 

9 {r,(I)"}» det ([7 + 3 ~ l]qTq{a + l + 2 ))i<«<n 

because of (q a ; q) n = (1 — q) n ■ F p a ^ , and the right-hand side equals 

n 
fc=l 

because of the relation Qn(a ; ; A B; q) = p n (x; A, B, 0, 0; q) between the Al- 
Salam-Chihara polynomials and the Askey- Wilson polynomials. Hence we 
obtain Nishizawa's formula (11.91) corollary. 

In Section [3] we derive the following corollary from Theorem 11.11 

Corollary 1.3. Let a, b and c be parameters, and let n > 1 and r be integers. 

(i) If the size n = 2m of the matrix is even, then we have 



i-1 ( a <?; <?)i+i+r-2 



det ( (q l — cq 



(abq 2 ;q) l+j+r ^ 2 J 1 



i<i,j<2m 



Q 2m(m-l) c m g 2 " 1 ^"- 1 » 4 '"+ 1 ) +2m(m-l)r-Q / (gj g)2fc-l(agi gWr-lggj g) 2 fc-2 ' 



fc=l 



(abq 2 ;q) 2 (k+ m ) 



+r-3 



(^-2m ^-1^-2-m+l £ c ~l ^ \ 
r'+l — It — 1 l-4m-ri 9 >9 (1-18) 
g,ag + ,a b q r J 



"■' 8l " 2 t 3m - 2) +m(2m-l)r TT N^Mt+M 



-_ 1 Nm Q m(2m-l)7 ) m c m g mttim + J m ~ 2 > +m(2m-l)r TT 

(abq 2 ]q) k+2m +r-2 



m / -I- _1 \ 

<?k-2} 2 • Pm ; 1, g, < +1 , a-^- 1 ? 1 " 4 ™-- ; g 2 

J,_1 V / 



111 

x 

fe=i 



;i.i9) 
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fii) If the size n = 2m + 1 of the matrix is odd, then we have 



det U^-cj- 1 ) .^?*- 2 ) 
V {abq 2 ;q) i+j+r _ 2 J 



2m2 m 2 m(m+ i)(4,„-i) +2m2r 1 - c (q; q) 2k _ l (aq; q) 2k+r _ 2 (bq; q) 2k -2 

(ICQ 3 



(abq 2 \ ?)i+i+r-2/ i<ij<2 m+ i 

— TT 

1_ 9 fc = i (a&g 2 ;g) 2(fc+m _i) +r 

v TT ( ( li ( l)2k-i(aq]q)2k+r{bq]q) 2k - 2 ( q~ 2m ,b~ l q- 2m+1 , eg, c _1 g 2 2 N 
(a6g 2 ;g) 2(A . +m _i )+r \q ,aq ,a b q 



k=l 



(1.20) 



'_ 1 Nm a m(2m+l) fo m c m/ 1 _ A g m(8m2 + 15w+4 ) +m(2m+l)r TT (gj g)fc-l( Q gi g)fc+r-l 
m +l m /c + C 1 

< n ^ ^ 2fc - 2 ■ , ?) 2fc - 2 ■ ^ ( 2 ° ; g ' g2 ' agr+1 ' a " i6 ~ i ?~ 4wi ~ r ~ i ; ? 
fc=i fc=i ^ 

(1.21) 



Remark 1.4. If we put c = 1 in (jl.lBp for the even case, then it is clear 
that the 4^3 sum reduces to 1, so that the determinant becomes the product 
which equals the square of the Pfaffian fll.Sp obtained in [7J. Meanwhile, it 
does not suffice to prove (jl.8p since it is not so trivial to take the square root 
of the determinant and determine the sign (see [31 [7]). If we put c = 1 in 
( jl .201) for the odd case, then the factor (1 — c) reduces the right-hand side 
to 0. 



If we put a = q a , b = q 1 and c = q 1 and let q — > 1 in Theorem 11.11 then 
we obtain the following corollary. 

Corollary 1.5. Let a, (3 and 7 be parameters, and let n > 1 and r be 
integers. Then we have 

(a + l) i+J - +r „ 2 



det (7 + j - i)- 



a + f3 + Z 



i+j+r-2/ i<j, 7 < 



2)ra f a±l + l + r + l \ _jj^-l)!(a+l) fc+r (/3 + l) fc _ 2 



(a + (3 + 2) fc+ n+r-2 



(22)" ]~J ^ + + !)fc- 



fc=l 



(a + /3 + 2) fc+n+r _ 2 



a + 7 + r + l /3 a — 7 + r + l /3 1 
x P n ( 0; 7 - , |, 7 - , I ) , (1.23) 
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where 



P n (x;a,b,c, d) 



a + c) n (a + d) n ( —n,n + a + b + c + d — I, a + ix 

: • a-To ; 1 



n\ \ a + c, a + a 

are the continuous Hahn polynomials (see [TOl [TT]). 

The Wilson polynomials W n (x; a, (3, 7, 5) [TO, EEL] are defined by 

W n (x 2 ; a, (3, 7, 5) /— n, a + /9 + 7 + 5 + n — 1, a + zx, a — ix 

(a + /3) n (a + 7) n (o! + <5) n 4 V q + /3, q + 7, q + 5 

(1.24) 

By the same specialization as above, we obtain the following corollary from 
Corollary 11.31 

Corollary 1.6. Let q, (3 and 7 be parameters, and let n > 1 and r be 
integers. 



(i) If the size n = 2m of the matrix is even, then we have 
det ( (7 + j - i) 



(q + l)j_)_j +r _2 
(a + /3 + 2) i+j+r ._ 2 y i < ij .< 2m 



2 / _ m> 
(q + /3 + 2) 2(fc+m)+r „ 3 / U ^ "2m 



nj (2fc - l)!(q + l) 2fc+r _i(/3 + l) 2fc _ 2 I / _ m> _£i^_ m>2 



(1.25) 



AJ J (« + /? + 2) fc+2m+r _ 2 1 



xW m (-— ;0,-, ,-2m . (1.26) 

(ii) If the size n = 2m + 1 of the matrix is odd, then we have 



m+l 



(« + /? + 2) i+j+r - 2 J i<ij< 2m+ l 

(2fc - l)!(q + l) 2fc+r - 2 (/3 + l) 2fe _ 2 -pr (2fc - l)!(a + l) 2fc+r (/3 + l) 2fc _ 2 
AJj (q + /3 + 2) 2(fc+m _i )+r (q + /3 + 2) 2(fc+m _i )+r 



2m+l /, -.x m+l m 



A (q + /3 + 2) fc+: 



fc=l V ' / n,T-«,--r,- J . fe=1 fc=1 

7 2 1 « a + r + 1 q + /3 + r + l\ 
x W m ( -— ; -, 1, , -2m j . (1.28) 
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This paper is composed as follows. In Section [2] we give a generalization 
of Theorem 11.11 which is a determinant formula for arbitrary rows (see The- 
orem [27TJ) . The most labors to prove our theorems exist in the proof of this 
formula. In Section [3] we prove the main theorems in this section from The- 
orem 12.11 which will be straightforward. In Section H] we derive a quadratic 
relation among the Askey- Wilson polynomials as a corollary of Theorem 11.11 



2 Determinant formula for arbitrary rows 

In our previous paper [B], we prove the following formula in which the rows 
are arbitrary chosen. Let n be a positive integer, and k±, . . . , k n be arbitrary 
positive integers. Then we have 

det i\ 2 T — = a 2 q 6 

(og; q) ki - 



i=l \ * Ti/ K t^ n z l<i<j<n j = l 

This formula is a generalization of (11. 7p and a special case is obtained in 
[8j Theorem 3]. In this section we give this type formula, i.e., Theorem 12.11 
which is crucial to prove Theorem 11.11 

First we fix some notation. If a and b are integers, we write [a, b] = 
{x G Z | a < x < b}. We also write [n] = [l,n] for short. If S is a finite set 
and r a nonnegative integer, let ( ) denote the set of all r-element subsets 
of S. Let A be an m x n matrix. If i = (ii, . . . , i r ) is an r-tuple of positive 
integers and j = (ji, . . . ,j s ) is an s-tuple of positive integers, then let = 
j^, 1 ,...,t r j eno ^ e foe su bmatrix formed by selecting the row i and the column j 
from A. The main aim of this section is to prove the following key theorem. 

Theorem 2.1. Let a, b and c be parameters. Let n be a positive integer, 
and k = (ki, . . . , fc n ) be an n-tuple of positive integers. Then we have 



(a6g 2 ;g) fci+i _ 2 



1<« j'<n 



n(n-3) n(n + l)(n-4) JX- (ag; g) fc ! (6gj g)j_ 2 "pr fc , j 

a q n W;g) , +n , n (9* 



x ^(-l)"-^(a6cg^ +1 ; q 2 ) n . u (acq; q 2 ) u R n , u {k, a, 6; g), (2.2) 

IS=0 



where 



J R n ,,(fc,a,6;g) = ^g^T^-+- 

x JJ(1 - aq k ^ il + l + v ) Y[(l - abq k n +jl - l + v - 1 ). (2.3) 
i=i i=i 
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Here the sum on the right-hand side runs over all pairs such that [n] 

is a disjoint union of i = {i u i n _ u } E ( n W J and j = {j u . . . , j v ) E ( [ ™ ] ) 
(i.e., i U j — [n] and i D j — 0). Hereafter, we also use the convention that 
Rn^{k, a, b; q) is unless < v < n. 

For example, if n = 3 and ^ = 2, then the pairs runs over 
{({1}, {2,3}) , ({2}, {1,3}), ({3}, {1,2})}. 

Hence we have 

RsAih, h, k 3 }, a, b- q) = (1 - ag fel+2 )(l - a6g fc2+2 )(l - abq k * +2 ) 
+ g(l - ag fc2+1 )(l - abq kl+1 )(l - abq k * +2 ) 
+ q 2 {\ - aq kA ){\ - abq kl+1 )(l - abq k2+1 ). 

Let n be a positive integer, and let a, b, c and q be parameters. For 
an index set k = {ki,...,k n } of positive integers, let M n (k,a,b,c;q) = 
(M n (k,a,b,c;q)i i j) 1<i j <n denote the matrix whose entry is given by 

M n (k, a, b, c; q) id = (q^ 1 - cq^ 1 ) (ag fcl ; q) j _ 1 (abq ki+i ] q) n -j- (2.4) 
Then we have 

det ( (q^ - cq^ ^V^' 2 ) = ft r ' det °' 6 ' C ' ^ 

V {abq 2 ;q) k . +j - 2 J i<i,j<„ fj[ {abq 2 ;q) ki +n-2 

(2.5) 

Hence it is enough to evaluate det M n (k, a, b, c; q) to prove Theorem 12. II The 
main task of this evaluation is to show the following recurrence equation: 

det M n (k, a, b, c; q) 



a n 2 (bq; q) n _ 2 U^ = i(q k ' - q kn ) 

= q~ l {l - acq){\ - abq kn+n ~ l ) det M n _ x (k\ aq, b, cq; q) 

_ q n(n-S)/2(i _ abcq 2 "- 1 )^ - aq kn ) det Af n _i(fc', a, b, c; q), (2.6) 

where k' = {hi, ... , k n _{\ denote the subset of the first (n — 1) indices of 
k = {ki, . . . , k n _i, k n }. This identity enable us to prove Theorem 12.11 by 
induction. First we cite the g-binomial formula [U [TOj [11] [16] (see also [T5| 
Lemma 2]). 

Proposition 2.2. Let n be a nonnegative integer. Then we have 

n 

W M/2 PI =(x;g)n . (2 . 7) 



fc=0 
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Our method to evaluate det M n (k, a, b, c; q) is completely different from 
Mehta- Wang's proof or Nishizawa's g-analogue. It seems very tough to gen- 
eralize their proof to our case. So we establish the inductive identity (12. 6|) 
and appeal to the induction on the matrix size. For the purpose the fol- 
lowing proposition plays an essential role in the matrix multiplication of 
M n (k, a, b, c; q) which we use in the proof of Lemma [2.51 

Lemma 2.3. Let n be a positive integer. Let a, b, c and q be complex 
numbers, and x\,. . ., x n be variables. Then we have 



_^{q_ 1 x v - cq> x ){ax v \ q)j_ x {abq l x v \ q) n . 



j 



x v (l - ax v ) n?=i (%i - x h 



cq'- 1 , n (-l) n a n - l q-\l - acq)(bq-q) n ^ 

XV = 1) nn m x , (2.8) 



-E 



{q~ x x v - cq 3 ~ l )(ax v ] q) j - 1 (abq 3 x u ; q) n -j 
x u (l - abq n - l x u ) n"=i {%i - x v ) 

Ctf- 1 a »-l g »(n-3)/2 (1 _ abcq 2n-l^ bg . ^ 



Proof. There are several methods to prove these identities. Here we present 
a simple proof by the complex analysis (see [5]). Let F(z) be the meromorphic 
function of z defined by 



F(z) 



(q x z - cq ] l )(az] q) j _ 1 (abq J z; q) n -j 



z(l-az) Ui =1 (xi-z) 
Then z — x v {y — 1, . . . , n) is a pole, and its residue is 

(q~ l x u - cq>- x ){ax v \ q) j - 1 {abq 3 x v \ q) n . 



Res F{z) 



x v (l - ax u ) []™=i (xi - x h 



Similarly z = is also a pole, and its residue is 

cq 3 ~ ^ 

Res F(z) = -™ . 

2=0 1L=i x i 

At z = a~ l , F(z) has the residue of 

R es F ( z ) = _i^£ 1 - c 9 i-1 )(!; q)j-i(i>q j ; q) n - j 



-xU 



nr =1 (x, - a- 1 ) 

(aT 1 *? -1 - c)(bq; g) n _i 



Finally z = oo is also a pole of F(z), and KesF(z) = — lim zF(z) = 0. Since 

z=oo z—^oo 

the sum of the residues of a meromorphic function on a compact Riemann 
surface must be zero, we obtain the desired identity (I2.8p . The other identities 
can be proven similarly. The details are left to the reader. □ 



10 



Notice that an immediate consequence of these identities are the follow- 
ing Vandermonde type determinants. These identities are obtained from 
Lemma 12.31 by expanding the determinants along the last columns. 

Corollary 2.4. Let n be a positive integer, and k be an integer such that 
1 < k < n. Let a, b, c and q be parameters, and x = (x\, . . . ,x n ) be an 
n-tuple of variables. 

(i) Let V n>k (x,a,b,c;q) = (V n>k (x, a, b, c; q)i,j)i< id < n be the n x n matrix 
defined by 

jxf~ if 1 < j < n, 

V n , k {X, a, b, C] q) itj = < (x i -cq k )(ax i ;q) k _ l (abq k x i ;q) n „ k ^ • _ 

^ Xi(l-axi) J ' 

for 1 < % < n. Then we have 

det V nik (x, a, ft, c; q) 

Ti-l<i<j<n( X j ~ X i) 

cq k +x{k = 1) {-iTa^il-acq^bq-q^x 



(ii) Let W n)k (x, a, b, c; q) = {W njk {x, a, b, c; q)^)^^ be the n x n matrix 
defined by 

\x{~ 1 if 1 < j < n, 

W n>k {X, a, 6, q q) id = < ( Xi -cq k )(ax i ;q) k _ 1 (abq k x i ;q) n ^ k . f . _ 

L Xiil-abq^Xi) J fi > 

for 1 < % < n. Then we have 
det W ntk (x, a, b, c; q) 

T\-l<i<j<n( X j ~ X i) 

C q k , fl n-l (n-l)(n-2)/2n _ a & cg 2n-lW &g . g N 

= n) 



"nr=i^ v 7 nr=i(i-^ n "^) 

Here we will not use these Vandermonde type determinants, but it seems 
that these identities are worth mentioning. We introduce four triangular ma- 
trices X n (k,a;q), Y n (q), L n (k,a,b;q) and U n (q) which plays an important 
role to manipulate M„ (k, a, b. c: q) in ( 12. 5p . Let X n (k, a; q) = (X(k,a;q)ij) 1<:i - <n 
and Y n (q) = (V n (g) ij ) 1<i - <n be the n x n lower triangular matrices whose 
(i, j)-entry is, respectively, given by 

X(k, a; q) id = xi^J) ? (2 1Q) 

q k i{l — aq k i) YYi=i{q kl — q kj ) 

1^3 



(i-j)(2n + l-i-j) 



n-j 
i-j 



(2.11) 
-j i 
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Similarly, let Ljk, a, b; q) = (L n (k, a, b; g)ij)i<ij< n ( res P- u n{o) = ( u (<l)i,j)i<i,j<n 
) be the n x n lower (resp. upper) triangular matrix whose (z,j)-entry is, 
respectively, given by 



L n (k, a, b- g) y = -_ fc .^_-^ ; -, (2.12) 



U(q)ij = (-l) i+j q 



X(i > J) 

q k i(l - abq k o+ n - 1 ) [TLi (q k ' - q k i) 

J-l" 
3-i. 



(2.13) 



The fact that these are all triangular matrices is very important in the follow- 
ing proof. But, note that these triangular matrices are irrelevant to the LU- 
decomposition of M n (k, a, b, c; q). The /^-decomposition of M n (k, a, b, c; q) 
seems another difficult problem. We define the nxn matrices P n (k, a, b, c; q) 
and Q n (k, a, b, c; q) by 

P n (k, a, b, c; q) = X n (k, a; q)M n (k, a, 6, c; q)Y n (q), 
Q n (k, a, b, c; q) = L n (k, a, b; q)M n (k, a, b, c; q)U n {q). 

Since X n (k,a;q), L n (k,a,b;q) are triangular and Y n (q), U n (q) are unitrian- 
gular, we easily obtain 

, , „ /, , \ (-l) n detM n (fc,a,6,c;g) 
det P n (fc, a, 6, c; g) = — — — , (2.14) 

9^ i=1 *\[i=iO- ~ aQ k, )Ui< i< j< n (.Q % -T ] ) 
(-If det M n {k, a, b, c-q) 

det Q n (k, a,b, c; q) 



q u=i ^ nr=i(! - a&? fei+n x ) rii<i<i<n(^ fci - ^) ' 

(2.15) 

The key to prove (12. will be Lemma 12.71 To prove Lemma 12.71 we need 
the following lemma which gives the bottom rows of P n (k,a,b,c;q) and 
Q n (k,a,b, c; q). 

Lemma 2.5. Let n > 2 be an integer, and let a, b, c and g be parameters. 
Let X n (k, a; q), Y n (q), L n (k, a, 6; q), U n (q), P n (k, a, 6, c; g) and Q n (k, a, b, c; g) 
be as above, and M n (k,a,b,c;q) as in ( 12 ,4p . Then the bottom rows of 
P n (k, a, b, c; g) and Q n (k, a, b, c; g) are given by 

ifl<j<ra, (2.16) 
cg n_1 ~^"=! if j = n, 
C g-EI l =i fc i if j = 1, 

Q n (k,a,b,c;q) n<j = { if 1 < j < n, 

(2.17) 



a n-l g n(n-3)/2 (1 _ abcg 2n-l )(feg;g)n _ 1 

nr=i( i - afe <? fci+n_1 ) 7 
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Proof. By substituting xi = q kl for / = 1, . . . , n into (12. 8p . we see the (n,j) 
entry of X n (k, a; q)M n (k, a, b, c; q) equals 

'-l) n a n_1 g -1 (l - acq)(bq; q) n _ 1 



cq 



nr=i(i-^o 

Since Y n (q) is lower unitriangular, the (n, l)-entry of X n (k, a; q)M n (k, a, b, c; g) 
affects only the first entry of the bottom row of X n (k, a; q)M n (k, a, b, c; q)Y n (q). 
Hence, if j 7^ 1, then we have 



P n (k,a,b,c;q) n>j = 



Q-j)(2n + l-i/-j) T-~,n , 
2 2^=1 K l 



n-j 



By replacing v by n — u, we obtain 



P n (k,a,b,c; q) nJ = cq 



j-i-ET =1 fc; 



n-j 



D-d 



i/=0 



n - j 



By (12.71) . this equals cg n-1- ^ =1 fci if j = n, and otherwise. The case where 
j = 1 is easily obtained from 1^(9)1,1 = 1. This proves ( 12. 16ft . The other 
identities can be proven similarly. The details are left to the reader. □ 

Proposition 2.6. Let n be a positive integer, and q a parameter. Let Y n (q) 
and U n (q) be as in (12. lip and (I2.13p . Then we have 



YrMY 1 

Uniq)- 1 
Especially, we have 



q 



(j-i)(n+l-i) 



n-j 
i-j 



q / Ki,7< 



3Sn 



i - 1 



V Ki,i< 



dety n (g)[; ; :L\« = (-g)-, 
detl/ n ( g )^ w = (- g )*- 1 . 



(2.18) 
(2.19) 

(2.20) 
(2.21) 



Proof. To prove that (I2.18P gives the inverse of Y n (q), one need to show that 

-l) k+1 q- 



^2 q (k-i)(n+l-i) 



k=j 



n — k 
i — k 



^ k+ j (fc-j)(2n+l-fc-j) 



n-j 
k-j 



(-iy + v 



rt-jVgn+l-i-j) 



n - j 
n — i 



1-3 



(-l) fe g— 



9 fc=0 



J 9 
fc 



equals \{i = j), where the second sum is obtained from the first sum by 
replacing i — k by k. This can be shown by (12. 7p . It is also an easy exercise 
to show that (I2.19P gives the inverse matrix of U n (q) using (12 .7p . Finally, 
JZI2DD (resp. AMID ) is obtained from (|2~T8|) (resp. (1239]) ) using the relation 
A -1 = adj(A), where the adjugate matrix adj(A) is the transpose of the 
matrix of cofactors. □ 
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Let n < N be positive integers, and let A be an n x N matrix and B an 
N x n matrix. Then the following formula is known as the Cauchy-Binet 
formula: 

det AB= £ A ^ B U- (2-22) 

Lemma 2.7. Let n be a positive integer, and let a, b, c and q be parameters. 
Let P n (k,a,b,c;q) and Q n (k,a,b,c;q) be as defined in Lemma [231 When 
k = {hi, . . . , & n } is a row index set, let fc' = {/c 1; . . . , fc n _i} denote the 
subset of the first (n — 1) indices of k. Then we have 

g 2^=i *• ni<i<i<n(3 fci -<r 3 ) 

det Q„(*, a , 6, c; ,)[!-;! = a^^f , (2.24) 



detP n (fc,q,fe, c; g)jj;"_j| = ^ det Q n (fc, aA q g)}^ 11 



Proof. Since X n (k, a; q) and are lower triangular, we have 

P n (k, a, b, c; q) 1 ^ 1] = X n (k, a; g)[}£l}] M n (fe, a, 6, c; g)^™]" 11 ^(g)^"] 
Hence, (I2.23P easily follows from 

detX n (fc,a;g)[;' n - 1] 1 1 !^ 



n ^ gE"=i nLl^ 1 - a( l K ) TilKiOKrSff* ~ <P> 
n-l 

det M n (k, a, b, c; q)\ 2 l~ l] = - ag fc ') ■ det M n _i(fe', ag, 6, eg; g), 



«/=i 



dety„(g)g 



1. 



Here, the first and the third identities follow from the fact that X n (k, a; g) and 
Y n (q) are lower triangular, and the second identity follows from the fact that 

entry of M n (k, a, 6, c; g)^™]" 11 equals (q ki - 1 -cq j )(aq k '; q) j (abq ki+j+1 ; g)„_,_i 
for 1 < z,j < n (see (12.41) ). Exactly the same argument proves (12.241) from 
the fact 

Q n (k, a, 6, c; = L n (fe, a, 6; Af n (fe, a, b, c; g)[}jljj #n(?)[l£l}]- 

The details of this argument are left to the reader. Finally, we prove (12. 25ft . If 
there is no fear of confusion, we may write M n (k, a, b, c; q) (resp. P n (k, a, b, c; g), 
Q n (k,a,b,c;q), X n (k,a;q), Y n (q), L n (k,a,b;q) and U n (q)) as M n (k) (resp. 
P n (k), Q n (k), X n (k), Y n , L n (k) and U n ) in short hereafter. We use the 
identities 

P (h\ [1 ' n ~ 1] — X (k\ [l ' n ~ 1] M (h\^ 1>n ~^Y [1,nl 
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which come from the triangularities of the matrices as before. Hence, by 
taking the determinant of the both sides, we obtain 

detp n (fc)[; : ::;j = detx n (k) [ ^ . ^mm^y^, 

det Q n (k%%- 1] = detL n (fc)[; ; :i;] • deiM^k)^ U n ™. 

Since the X n (k, a; ?)m'"Ii] and L n {k, a, b; ?)m'"Ii] are lower triangular, it is 
easy to compute the first determinant of the right-hand side of each equality 
Applying the Cauchy-Binet formula (I2.22p to the second determinant of the 
right-hand side of each equality, we obtain 

f_1)»-iV n det M (k) [1 ' n ~ 1] det Y [1 ' n] \ {i} 

UCL r n\l^) l, n -l ^P n - 1 k Tf n - 1 /^ k \ TT /- . \ ' 



det Qn(fe) 



<?<r 

f_1\n-iv-n Hpt M fit-V 1 '™ -1 -' rlpt 77 [1 ' n] \ W 

[l,n-l] _ ^ ^ 2^i=i aelIV1 n{^)[i. n ]\{i}^lU n[2n] 

f2.nl Y^ n_1 l- TT«— 1 



Hence (12.251) immediately follows from Proposition 12.61 This completes the 
proof. □ 

Now we are in position to prove (12. 6p . 

Proof of (12. 6p . Expanding P n (k) and Q n (k) along the bottom row, we ob- 
tain 

,,pm a n - l q- l {l -acq){bq;q) n _ 1 /.x[i,n-l] 

+ C gn-i-Er= 1 ^ d etP n (fe)[^: i 1 j, (2.26) 
detQ n (fc) = (-lf+^g- £?=i*< detg n (fc)^f 1] 

from (|2~T6|) and fl2TT7jl . Hence, substituting fl2~T4j) and fl2T23|) into (|2T26|) . 
f l2~T5]) and (IZ33j) into (EEZ7j) . then the resulting equalities into ([2T25]) . we 
obtain the desired identity. □ 

Now we are in position to prove Theorem 12.11 In fact the proof is straight- 
forward by induction. 

Proof of Theorem 12.11 First, we note that, for any integers n and is, it 
holds 

Rn, v (k, a, b; q) = (1 - abq^^Rn^^k' , aq, b; q) 

+ q n -\l - aq kn )R n - hv (k' , a, 6; g), (2.28) 
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where k = {ki, . . . , k n _i, k n } and k' = {ki, . . . , fc re _i} are as before. (I2.28P 
follows from the definition (I2.3P of R ntU (k, a, b; q) by considering two exclusive 
cases, j u = n or i n _ u = n. Now we prove the identity 

n 

n(n — 3) n(n + l)(n — 4) -| — r 

det M n (k, a, b, c; q) = {-l) n a^^q e [[(bq; q)^ 2 

i=i 

n 

x II -^" 1 )^(-l)"(aM 2 " +1 ;g 2 )n^(acg;g 2 ) 1 , J R n , l ,(fc,a,6;g), 

l<i<j'<n v=0 

(2.29) 

by induction on n. If n = 1, then the left-hand side of (12.291) is trivially 
q kl ~ 1 — c from ( 12. 4p . It is straightforward computation to check the right- 
hand side equals q kl ~ 1 — c. Assume n > 1 and (I2.29P holds up to (n — 1). 
Using (12. 6p and the induction hypothesis, we obtain 

det M n (k, a, b, c; q) 
(-l) n a^ J1 q n(n t J) Y[ n i=1 {bq] g);_ 2 lli^^^ ~ Q k] ) 

n-l 

= (1 - abq^- 1 ) J2(-iy + \*bcq 2v+3 ; <?) n _ v _ x {acq; q 2 ) u+1 R n ^Ak\ aq, b; q) 
n-l 

+ q n -\l - aq k ") ^(-l)^(a6cg^ +1 ; q 2 ) n -„(acq; q\R n ^(k', a, 6; <?). 

i/=0 

Replacing u + 1 by z/ in the first sum and applying ( 12.28ft . we establish ( 12. 291) 
for n. Hence ( I2.29P holds for an arbitrary positive integer n. Finally, ( 12 .5p and 
( I2.29p immediately implies ( 12. 2p . This completes the proof of Theorem 12.11 
□ 

To recover (12. 11) from Theorem 12.11 one can prove 

n 

J2(-l) n - V RnAk, a, b- q) = a^T+ELx h (6; q)n (2 30) 

i/=0 

by induction, appealing to ( I2.28p . If he substitutes (I2.30p into (12. 2p . then he 
obtains ( 12. ip immediately. 

3 Proof of the main theorems 

The aim of this section is to derive Theorem 1 1 . 1 1 from Theorem 12.11 and then 
prove Corollary 11.31 from Theorem 11.11 Once we prove Theorem 12.11 then it 
is easy and straightforward to prove the main theorems mainly by induction. 
First, to prove Theorem 11.11 we set k — [n] — {1, 2, . . . , n} in (I2.2p . Hence, 
it is essential to prove the following lemma before proceeding to the proof of 

dmsj). 
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Lemma 3.1. If we put k = [n] in (12. 2p . then we obtain 



R n:l/ {[n\,a,b;q) = q 2 



n 



(aq u+1 ;q) n ^(abq n ;q) l 



(3.1) 



Proof. We proceed by induction on n. If n — 0, then the both-sides are 
equal to 1 if v = 0, and otherwise. Let n > 0, and assume (13. ip holds when 
n — 1. By (12. 28 j) . the left-hand side satisfies 

Rn,„([n], a, b; q) = (1 - a&g 2n_1 i([n - 1], aq, b; q) 

+ q n -\l - aq n )R n ^ u {[n - 1], a, 6; q). 

Substituting the induction hypothesis into this identity, we see the right-hand 
side equals 



(n — is) (n — is — 1) 



(aq ]q) n -v{abq n - ) q) v - 



n — 1 
f - 1 



'1 — abq 



2n-l> 



9 



n — 1 
v 



[1 — abq 



which becomes the right-hand side of ( 13. ip . Hence this proves that (13. ip 
holds for an arbitrary nonnegative number n. □ 



Now we are in position to prove Theorem 11.11 

Proof of Theorem 11.11 If we substitute k = [n] into (12. 2p using (13. ip . then 
we see that det ((q 1 " 1 — cq^ 1 ) ^^q) j + 2 ^ ) equals 



"("-3) Mn+±)(2=*1 -A- (aq; q) k -i(bq; q) k -2 tt 
a 2 q 6 11 7^^A— 11 



(abq 2 ;q) k+n . 



f- 1 - tf- 1 ] 



l<i<j<n 



£(-ir 



(n — i^)(n — i/— 1) 



i/=0 



n 



v 



(abcq 2u+l \ q 2 ) n _ u (acq\ q 2 ) v (aq l/+1 ] q) n - u (abq n \ q) 



By rewriting the sum with the basic hypergeometric series by using rii<i<j<n(9 



i-l 



r i )=q nJ ^ 1 mz i o(^^ a 

gg^and (aq^q) n 



is(is-l) ( n — n. n \ 

%v — ^ — yq ,q)v 



.\yq nv - "%^f, (abcq- 



2v+l. n 2\ 



_ (aq,q)n becomes 

v [WW* ' 



n(n-3) n(n + l)(2n-5) 



-l) n a^g 



(abcq; q 2 ) n JJ 

k=l 

ill 



(gj g)k-i(aq;q)k(bq; g)k- 

(abq 2 ; q) k+n -2 



a2C2q2^—a2C2qz,q n ,abq r ' 

X 4^3 | I,!!! 1,111 i 9)<? 



If we replace a by ag r , and multiply the both sides with j , then we 

obtain ( II. 15p . There are several ways to write 1 11. 15ft with the Askey- Wilson 
polynomials, and ( 11.16j) follows from ( 11. 15[> using the definition (II. 6ft . □ 
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Before we proceed to a proof of Corollary 11.31 we need the following contigu- 
ous relations for 4 3 . 

Proposition 3.2. Let z, a, b, c, d, e, /, g and q be arbitrary parameters. 
Then we have 

fa,bq,c,d \ f aq,b,c,d 

403 , ; q, z - 403 , ; g, 2 



,9 J \ e,f,g 

z (b — a) (1 — c)(l — d) ( aq,bq,cq,dq 



(l-e)(l -/)(!-#) 4 3 V eq,fq,gq 



■q,z), (3.2) 



(1 - /)(« - e) 4 03 ( a,b,< l ,d ;q, z J - (1 - e)(a - /) 4 3 ( a,b,c,d ; q ^ z 



/? "2 7 ~ I V \^ j / '-t r o i /• 

,0 / \e,jq,g 

= (! - «)(/ - e )403 ( a<? ' fo ' C ' rf ;g,2] , (3.3) 

and 

(l-e)(l-/)(l-^) 4 3 f a ' 6 ' f C '^^ 

n v A A A 9\ , ( aq,bq,c,d 
= c(l-e) 1-- 1-- 403 , \q,q 
V cj V cJ V e,fq,gq 

^-'('-SO-S^ftW")' (3 ' 4) 

where, in the last identity, we assume abcdq = efg and a = g _n for some 
nonnegative integer n. 

Proof. First, (13. 2p and (13.31) are readily proven by direct computation. The 
last identity ( 13. 4 p is written as 

(l-e)(l-/)(l-^) 4 3 g ' <* 

A (, 9\ j. (q~ n+ \ eJ *f,c,d 



+ .(l-c)(l-^)(l-^ 403 (^ +1 '^-^,,), (3-5) 
V dJ \ cdj V eq,fq,gq J 

and can be proven by induction on n by using only ( 13. 2D . The details are left 
to the reader. □ 

Remark 3.3. The contiguous relations (13. 2p (resp. (13. 3p ) correspond to (3.2) 
(resp. (3.10)) in [9], meanwhile (I3.3P can be written as a contiguous relation 
for %Wj. In fact, if one uses Watson's transformation formula jU (2.5.1)] 



aV +2 \ (aq,7;q) f q~ n ,d,e,^ 

8 W 7 ( a; b, c, d, e, q*- q, = \ a JX q ) { I M ^ ; ^ 9 



(3.6) 
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for a terminating very-well-poised series, where 

r+1 W r {ai; a 4 , . . . , a r+1 ; q, z) = r+1 (f) r \ j _j ^ gai ; g, z ) , (3.7) 
then (13. 4 p is equivalent to 

/ _ a 2 q n+1 

(c — a)(d — aq)(e — aq)(b — aq n ) $Wy I a; b, cq, d, e, g n ; g. 



a(l — b)(l — aq)(de — aq)(l — cq n ) %Wi ( aq; bq, cq, d, e, q~ n+1 ; q 



2„n+l 

bcde 



+ (be- a)(d- aq)(e- aq)(l- aq n ) 8 W 7 ia;b,c,d,e,q " +1 ;g, — j . 

(3.8) 

The following proposition is crucial to derive Corollary 1 1 . 31 from Theorem ll.il 

Proposition 3.4. Let n be an integer, a, b and c be arbitrary parameters. 
Then we have 

p n (0;a,b,c,-c;q) = {-l) m a m b m c 2m q m ^ m ~ l \-c 2 ]q 2 ) m 

x p m (x ; 1, g, a&, -a- 1 ^ 1 ^^- 4 ^ 2 ; g 2 ) , (3.9) 

if n = 2m is even, and 

p n (0; a, 6, c, -c; g) = (-l) m+1 a m 6 m+1 c 2m (l + ab- x )q m{ ? m+1 \-c 2 ] g 2 ) m+1 

x p m (x ; 9, <? 2 , a&, -a" 1 6" 1 c~ 2 g~ 4m ; g 2 ) , (3.10) 



if n = 2m + 1 is odd, where Xo 

Proof. We proceed by induction on n. If n — — 1 (resp. n — 0), then the 
both sides of fl3~TU|) (resp. fl3T9]) ) equals (resp. 1). Hence ([32]) and f l3~TU|) 
holds when n = —1,0. Assume n > 1 and (13. 9p and (13 . 10[) hold when n — 1 
and n — 2. If n = 2m, then 

p 2m (0;a,6,c, -c; g) 
by (USD 

(ab,ac,—ac;q)2m , f q~ 2m , — ab^q 2 ™ 1-1 , ai, — ai 



a 2m 4 3^ ^ ^ _ ac j 9; 1 
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by dS2D 



(ab, ac, —ac; g) 2m (q 2rn+1 , —abc 2 q 2m 2 ,at,—at 



a 2m 4 3^ ^ a ^ _ ac i Q ^ 

- (1 + a 2 )(l + atf^-^'^-Wq)**-! 

X 403 , ; ?, ? 

\ aog, acg, —acg 

= a-^l - abq 2m ~ l ){\ - acg 2m " 1 )(l + acq 2 ™- 1 ) p 2m - 1 (0; a, 6, c, -c; g) 

- a _1 (l + a 2 )(l + abc 2 q 4m ~ 2 ) p 2 m-i(0; ag, 6, c, -c; g). 

By the induction hypothesis (13.10j) . this equals 

= (_l)^ a ^-2 6 m c 2m-2 ? (m-l)(3m-2)(_ c 2. 

x {(1 - a&g 2 ™- 1 )^ - acg 2m - 1 )(l + acg 2 ™" 1 )^ + ao" 1 ) 
x p m _i(x ; g, g 2 , ab, -a _1 r 1 c" 2 g _4m+4 ; g 2 ) 

- g^l + a 2 )(l + a6c 2 g 4m - 2 )(l + ab^q) 

x p m _i(xi; g, g 2 , abq, -a~ WV 4m+3 ; g 2 )}, 

where Xi = — — — 2+^ — — — . Hence, by (jl.6p again, this becomes 

= {-lTc 2m q m ^\-c 2 - q 2 ) m (abq 2 , abq 3 , -c" V*^; q 2 ) m ^ 

x { -a 2 (l - abq)(l + a _1 &)(l - a~ 2 C - 2 g- 4m+2 ) 
g - 2m+2) _ c -2 g - 2m +3 ; _ fl2) _ 6 2 2 2 

X4</>3t a6g,a6g 2 ,-c-V 4m+4 ;ff ' 9 
- o 2 (l + a6~ 1 g)(l + a 2 )(l + a^r^-V 4 "* 2 ) 

/„-2m+2 _„-2„-2m+3 _^2 n 2 _l2 

,/y i a q , u 22 

4<?>3 V a6g3,a6g 2 ,-c-V 4m+4 ' 9 ' 9 

Using (13.51) . we obtain 

= (_i)™ c 2m ? m(3m-i) (- C 2 , o6, a&g, -c"V 4m+2 ; g 2 ) 

/„-2m _„-2„-2m+l _„2 _l2 

* 4< H abq,ab,-c- 2 q-^ 2 ]Q ' ? 



by (II. 6p again 



-l) m a m 6 m c 2m g m(3m - 1) (-c 2 ;g 2 ) m 
x p m (x ; 9, 1, a&, -a^ 1 r 1 c~ 2 g" 4m+2 ; g 2 ) . 
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This proves (13. 9 j) when n = 2m. It is well-known that the Askey- Wilson 
polynomials (jl.6p are symmetric with respect to the parameters a, b, c and 
d. Meanwhile, the expression of the Askey- Wilson polynomials by the 4(^3 
series apparently depends on the choice of the parameter a in (II. 6ft . Note that 
we have to choose this parameter carefully in each step to apply the above 
contiguous relations. Similarly, when n = 2m + 1, ( I3.10P can be proven 
using the definition (I1.6P of the Askey- Wilson polynomials, the contiguous 
relations ( 13. 2p . (13. 3p and the induction hypothesis (13.91) for n = 2m. We omit 
the details for the reader. Hence we conclude that ( 13.91) and ( 13. lOj) hold for 
arbitrary m. □ 

When b = —a, replacing c by b, one gets incidentally the following known 
result due to Andrews (see [U (11.17)]). 

Corollary 3.5. 

p n (0;a, -a,b, -b; q) 

(-l) m (q, -a 2 , -6 2 , a 2 b 2 q 2m ; q 2 ) m if n = 2m, 
if n = 2m + 1. □ 

Proof of Corollary 11.31 When n = 2m is even, if we apply (13. 9p to (11.161) 

using (M 2 ) m ilfc=i(^;<?)fc-2 = JJJ=i{(k<?;<?)2fc-2} 2 t hen w e obtain p. 190 by 
straightforward computation. (11.181) is derived from (I1.19P by (11.61) and using 
(Q;Q 2 )mUlZi((i;(l)k^i = nr=i{(?;?)2fc-i} 2 , {aq r+l ]q 2 ) m Y\ 2 k Z 1 {aq]q) k+r+1 = 

When n = 2m + 1 is even, if we apply (I3.10p to ( 11.16D using 

2m+l m+1 m 

(b; q 2 ) m +i JJ (bq; q) k -2 = JJ {bq\ q)ik-2 ■ Y[(bq; q) 2 k-2 

k=l k=l k=l 

then we obtain (OB . Finally, ( OOj) is obtained from ( TOT]) by using (TOj) . 

(a" 1 r 1 g- 4m - r ;g 2 ) m = (-l) m a- m b- m q- m{3m+r+1) (abq 2m+r+2 ; g 2 ) m , 

2m+l m+1 m 

(? 3 ; g 2 ) m n (g; g)*-i = • II g^-i JJ^ ^-i, 

k=l ^ k=l k=l 

2m+l m+1 m 

(a<f +2 ;g 2 ) m JJ (ag; g) fc+r -i = JJ (ag; g) 2fc +r-2 JJ( a ^' ^) 2fc + r ' 
fc=i fc=i fe=i 

(a6g 2m+,+2. g2)m 



Ilfc=i (abq 2 ;q) k+2m+r -i 

1 



nj£i 1 (a6g 2 ; g) 2 fc+2m+r-2 lir=l( a V; g)2fc+2m+r-2 

This completes the proof of Corollary 11.31 □ 
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4 A quadratic relation 

In this section we use the Desnanot-Jacobi adjoint matrix theorem to derive a 
quadratic relation between the Askey- Wilson polynomials for a special values 
of parameters. 

First we recall the reader a well-known theorem for matrix. The fol- 
lowing identity is known as the Desnanot-Jacobi adjoint matrix theorem (2j 
Theorem 3.12] 

det det A§ = det A^j det A™ - det det A™. (4.1) 

Let 

D n (a, 6, c; q) = det ((q^ - cq^) ^'f^ 2 ) 
and apply (14. ip to this determinant. Then we obtain 

D n (a, 6, c; q)D n _ 2 {aq 2 , 6, c; q) = " Ai-i(a, b, c; q)D n _ 1 (aq 2 , b, c; q) 

q(l — aq) n (l — abq 3 ) n ~ 2 
~ (l-ag 2 )"~ 2 (l-aog 2 )" ' Dn ~^ 6 ' Cq; <?)A*-i(ag, b, cq~ x - q). (4.2) 

Hence we can substitute f l 1 . 1 6 j) into (14. 2p . Then we obtain 

aq(l — g n_1 )(l — bq n ~ 2 ) ■ p n (0; a^c^q^i, —ahc~^q^%, on, —b*i\ q) 

III 1 _1 3-1 JL . 

x p n _ 2 (0; a 2 c 2 q 2 i, —a 2 c 2 gn,5n, -on; q) 
= (1 — aq n )(l — abq n ) ■ p n _i(0; a^c^q^t, —a^c~^q^t, b^i, —b*i; q) 

, III I _I 31 1 . 

x p n _i(0] a 2 c 2 q 2 i, —a 2 c ^n, on, -on; q) 

2 -, III I _I I I ,1 

— (1 — aq)(l — abq ) ■ p„_i(0; a 2 c 2 gn, — a 2 c 2 q 2 i^b 2 i^—b 2 i\q) 

ill I _i 311 
x p n „!(0; a 2 c 2 gn, — a 2 c 2 gn,on, —on; g). (4.3) 

Replacing a^c^q^i, —a^c~^q^i and o^z by a, 6 and c, respectively in (14. 3p . 
we obtain the following corollary. 

Corollary 4.1. Let n be a positive integer and a, 6, c and g parameters. 
Then we have 

ab(l - q n ~ l ){l + c 2 q n ~ 2 )p n (0; a, 6, c, -c; g)p„_ 2 (0; ag, og, c, -c; g) 
= (1 - a6g n_1 )(l + a6c 2 g n_1 )p n _i(0; a, 6, c, -c; g)p n _i(0; aq, bq, c, -c; g) 

- (1 - a6)(l + a6c 2 g 2n ~ 2 )p n _i(0; ag, 6, c, -c; g)p n -i(0; a, og, c, -c; g). 

(4.4) 
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In other word 




+1 , —abc 2 q n 2 ,ai,—ai 
ah, ac, —ac 



;q,q 



;q,q] 

1+1 , —abc 2 q n ~ l , aqi, —aqi 
abq, acq, —acq 



) 



at, —ai 



;q,q 



) 



;q,q 



) 



) 



(4.5) 



Here we derive Corollary 14. II as a corollary of Theorem ll.il Note that, if 
one can prove the quadratic relation (14.41) or (14.51) directly, then he can prove 
Theorem 11.11 using the Desnanot-Jacobi adjoint matrix theorem (14.11) . This 
was our first strategy to prove Theorem ll.l[ but we have found it is not so 
easy to prove the quadratic relation. Hence we prove Theorem 12.11 which is 
more general, and then derive Theorem 11.11 

Finally, we state a conjecture which generalizes (14.41) . We can observe 
that the following quadratic equation with two more parameters could hold 
concerning to the Askey- Wilson polynomials: 

Conjecture 4.2. Let n be a positive integer and x, a, b, c, d and q param- 
eters. Then we have 

ab(l - q n ~ l ){l - cdq n ~ 2 )p n (x; a, b, c, d; q)p n - 2 {x; aq, bq, c, d; q) 
= (1 - a&g n_1 )(l - abcdq^^Pn^ifaajbjCjd; q)p n _x(x;aq,bq,c,d; q) 
— (1 — ab)(l — abcdq 2n ~ 2 )p n _i(x] aq, b, c, d; g)p n _i(x; a, bq, c, d; q). (4.6) 

Concluding Remarks This conjecture may hint us there could exist 
a more general formula than Theorem 11.11 But it is not an easy task to find 
the appropriate entry of the determinant which gives this quadratic relation. 

It is also an interesting problem to find a combinatorial application of 
Theorem ll.il If c = 0, then (1 1.7ft is the generating function of the Dyck paths 
with certain weights (see [6]). For c = 1, the Pfaffian (II. 8ft can enumerate 
certain reverse plane partitions (see [7]). We have been trying to find an 
application of Theorem 1 1 . 1 1 and it is not so easy to find an appropriate lattice 
path and its weights. It will be left for the future work. 

Acknowledgments We are grateful to Professor Christian Kratten- 
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